Original address: http://blog.fens.me/hadoop-family-roadmap/Sep 6,Tags:hadoophadoop familyroadmapcomments:CommentsHadoop Family Learning RoadmapThe Hadoop family of articles, mainly about the Hadoop family of products, commonly used projects include
Hadoop stream
Although Hadoop is written in java, Hadoop provides a Hadoop stream, which provides an API that allows you to write map and reduce functions in any language.The key to Hadoop flow is that it uses the standard UNIX stream as the
Using PHP to write a mapreduce program for HadoopHadoop Stream
Although Hadoop is written in Java, Hadoop provides a stream of Hadoop, and Hadoop streams provide an API that allows users to write map functions and reduce functions in any
In principle, hadoop supports almost any language.
Link: http://rdc.taobao.com/team/top/tag/hadoop-php-stdin/
Use PHP to write hadoop mapreduce programs
Posted by Yan jianxiang on September th, 2011
Hadoop itself is written in Java. Therefore,
Use PHP and Shell to write Hadoop MapReduce programs. So that any executable program supporting standard I/O (stdin, stdout) can become hadoop er or reducer. For example, copy the code as follows: hadoopjarhadoop-streaming.jar-input makes any
Hadoop itself is written in Java. Therefore, writing mapreduce to hadoop naturally reminds people of Java. However, Hadoop has a contrib called hadoopstreaming, which is a small tool that provides streaming support for hadoop so that any executable
Use Ganglia to monitor Hadoop and HBase Clusters
1. Introduction to Ganglia
Ganglia is an open-source monitoring project initiated by UC Berkeley designed to measure thousands of nodes. Each computer runs a gmond daemon that collects and sends
Enables any executable program that supports standard IO (stdin, stdout) to be the mapper or reducer of Hadoop. For example:
Copy CodeThe code is as follows:
Hadoop jar Hadoop-streaming.jar-input Some_input_dir_or_file-output Some_output_dir-mapper/
The streaming framework allows programs implemented in any program language to be used in hadoopmapreduce to facilitate the migration of existing programs to the Hadoop platform. So it can be said that the scalability of Hadoop is significant. Next
Enables any executable program that supports standard IO (stdin, stdout) to be a mapper or reducer of Hadoop. For example:
Copy Code code as follows:
Hadoop jar Hadoop-streaming.jar-input Some_input_dir_or_file-output
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.